Patent Application Atty. Docket No. 003797.00693 

MS 192049.01 

DYNAMICALLY ADJUSTING OPERATION OF ONE OR MORE SENSORS OF A 

COMPUTER INPUT DEVICE 

FIELD OF THE INVENTION 

[01] This invention relates to power management in electronic devices. In particular, the 
present invention relates to power management in a computer input device. 

BACKGROUND OF THE INVENTION 

[02] Wireless communication over relatively short distances is a common and increasingly 
important feature of electronic devices. In some cases, for example, an electronic 
device or other appliance is controlled by another electronic device which mus^t 
communicate instructions to the controlled device (and perhaps receive information 
from the controlled device). Examples include computer input devices such as mice. 
Among other advantages, wirelessly transmitting data and/or control signals between 
a computer and a mouse can dramatically increase user convenience and reduce 
clutter from multiple connecting cables. 

[03] An inherent challenge with wireless devices such as computer mice is power 
management. Wireless devices are usually battery powered. To prolong battery life, 
it is desirable to reduce the device^s power consumption as much as possible. Many 
wireless mice utilize an optical tracking system to determine mouse movement. By 
creating and correlating overlapping images of the surface across which a mouse 
moves, the mouse "navigates," i.e., measures relative motion across that surface. 
Although a significant advancement, the imaging components necessary for optical 
tracking consume a substantial amount of power. For example, existing CMOS 
technology used in some imagers requires an extraordinarily bright light source to 
illuminate the imaged region. This Ught source (typically a LED) draws a substantial 
amount of current when illuminated, and is often activated at relatively high rates 
(1500 frames per second or higher). When activated at a high rate for prolonged 
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periods, the light source (as well as the processing electronics) exhibit a significant 
drain on battery power. 

SUMMARY OF THE INVENTION 

[04] The present invention addresses the above and other challenges associated with power 
consumption by computer input devices. In at least some embodiments of the 
invention, a controller dynamically adjusts the rate at which an illumination source is 
activated, and may also adjust the rate at which other optical tracking system 
components are activated. As the velocity of optical tracking system movement 
relative to a tracked surface increases, the controller increases the activation rate(s). 
As the velocity of relative movement decreases, the controller decreases the activation 
rate(s). In at least some additional embodiments, future displacements of a tracking 
system relative to a tracked surface are estimated. In particular, relative tracking 
system/tracked surface velocity is calculated based on a series of images. Relative 
movement is then estimated based on the calculated velocity. 

[05] In one embodiment, the invention includes a computer input device having an 
electronic imager positioned to create images of at least a portion of a surface moving 
relative to the imager. The device further includes an illumination source positioned 
to illuminate at least a portion of the moving surface and at least one controller 
coupled to the imager and the illumination source. The controller is configured to 
selectively activate the illumination source, receive images from the imager, and 
determine (based on at least some of the images) a velocity of the imager relative to 
the surface. The controller activates the illumination soiirce at one of at least three 
activation rates when the imager velocity is being determined. The controller selects 
an activation rate based at least in part upon the determined imager velocity. In 
another embodiment, a controller is configured to determine, based on a first set of 
images, velocity of an imager relative to a surface. The controller is further 
configured to estimate imager displacement relative to the sxirface based on imager 
velocity and an elapsed time since movement from a position corresponding to one or 
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more of the images of the first set. In yet another embodiment, a computer input 
device includes a sensor positioned to detect changes in a measurable parameter, a 
power source and a controller. The controller is coupled to the sensor and the power 
source, and is configured to selectively activate the sensor, receive data from the 
sensor, and determine a sensor velocity. The controller activates the sensor at one of 
at least three activation rates when velocity is being determined, and selects an 
activation rate based at least in part upon the velocity. 

[06] These and other features and advantages of the present invention will be readily 
apparent and fiiUy understood from the following detailed description of preferred 
embodiments, taken in connection with the appended drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[07] FIG. 1 is a cutaway side view of a computer mouse. 

[08] FIG. 2 is a block diagram of the mouse of FIG, 1. 

[09] FIG. 3 shows successive image frames of a mouse moving across a work siirface. 

[10] FIG. 4 shows modified versions of the image frames of FIG. 3. 

[11] FIG. 5 shows successive image frames created at a rate that is too low by comparison 
to velocity of mouse movement. 

[12] FIG. 6 illustrates imaging at different rates based on velocity of mouse movement 
across a work surface. 

[13] FIG. 7 is a graph of a velocity vs. time velocity profile for a reciprocally moved 
mouse. 
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[14] FIG. 8 is a graph of imaging rate vs. time for a mouse moved according to the 
velocity profile of FIG. 7. 

[15] FIG. 9 is a flow chart showing an algorithm varying imaging rate based on mouse 
velocity, 

[16] FIG. 10 illustrates calculation of mouse velocity and acceleration, as well as 
estimation of future displacement based on velocity. 

[17] FIG. 11 further illustrates inertial mouse navigation according to at least some 
embodiments of the invention. 

[18] FIG. 12 is a flow chart showing an inertial navigation algorithm according to at least 
one embodiment of the invention. 

[19] FIG. 13 is a cutaway side view of a computer mouse according to additional 
embodiments of the invention. 

[20] FIG. 14 is a block diagram of the mouse of FIG. 13. 

[21] FIG. 15 is a flow chart for an algorithm varying imaging rate based on mouse velocity 
according to at least one other embodiment of the invention. 

[22] FIG. 16 is a flow chart showing an inertial navigation algorithm according to at least 
one other embodiment of the invention. 

[23] FIG. 17 is a flow chart showing an inertial navigation algorithm according to at least 
one further embodiment of the invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[24] The present invention permits improved power management in a wireless computer 
input device. Although the invention is described using a wireless, optically-tracking 
computer mouse as an example, the invention may also be implemented in other 
wireless devices using optical tracking. As but one example, the invention could also 
be implemented in a wireless trackball. In an optically tracking trackball, the tracked 
surface may be the outer surface of a ball which is rotatably captured within a 
housing. An imager within the housing detects displacement of the ball surface 
(relative to the imager) as a user rotates the ball. As another example, the invention 
could be implemented in an optical scroll wheel. In such scroll wheels, a rotating 
wheel is imaged, and the speed (and direction) of rotation relative to the imager 
determined. The invention may also be implemented in a computer input device 
having other types of sensors (e.g., pressure sensors, capacitive sensors, etc.). 

[25] In at least one embodiment of the invention, the imaging rate of the optical tracking 
system for a computer mouse is dynamically adjusted based on the velocity of mouse 
movement over a work surface. Because slower imaging rates can be used when the 
mouse moves more slowly, the amount of time which an illumination source is active 
(and thus drawing power) is reduced for slower mouse motion. In at least one other 
embodiment, future displacement of a mouse is estimated based on current mouse 
velocity. By estimating future displacement based on current velocity, it is possible to 
reduce the amount of time that an imaging light source and processing electronics 
must be active by reporting the displacement estimates while less periodically 
verifying velocity (or adjusting velocity used for displacement estimation). 
Additional features of the invention are described in more detail below. 

[26] FIG. 1 is a side, cutaway view of a mouse 10 in which various embodiments of the 
invention are implemented. Mouse 10 may have one or more buttons 12 which can be 
pressed by a user, a scroll wheel 14 or other types of input controls which can be 
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actuated by a user. The number, arrangement and types of input controls shown are 
merely exemplary, and other combinations and arrangements are within the scope of 
the invention. Mouse 10 also has at least one internal circuit board 16 upon which 
various electronic components are connected and physically supported. These 
components include an imaging array 18, a LED (light emitting diode) 20, a RF 
antenna 22, a controller 24 and a battery 26. Other components, not shown in FIG. 1, 
may include memory and other electrical components. LED 20 emits light which 
illuminates an area of a desktop or other surface, and which is imaged by imaging 
array 18. Images from array 18 are then compared and correlated to detect movement 
of mouse 10 across the desktop or other surface. Other components could be used in 
a mouse according to various embodiments of the invention. For example, an 
illumination source other than a LED could be used (e.g., an edge-emitting laser or a 
vertical cavity surface emitting laser). As another example, RF antenna 22 could be 
implemented as a set of traces on circuit board 16. 

[27] FIG. 2 is a block diagram of the internal circuitry of mouse 10 according to at least 
one embodiment of the invention. Operation of mouse 10 is controlled by a controller 
24. Although controller 24 is shown as a microprocessor (|jP), controller 24 could 
alternatively include state machine circuitry or other suitable components capable of 
controlling operation of mouse 10 as described herein. Controller 24 communicates 
with memory 28. Memory 28, which may include volatile and non-volatile memory, 
is a machine-readable medium used for storage of software (or firmware) instructions, 
imaging data and other information (such as algorithms discussed in more detail 
below). Memory 28 may include a rewritable non-volatile component, such battery- 
backed SRAM or EEPROM, and/or a non-rewritable component such as ROM. 
Controller 24 also controls LED 20 (FIG, 1), imaging array 18 and other imaging 
elements, all of which are represented collectively by imaging elements block 30. 
Controller 24 further controls RF communication circuitry 32, and passes data to RF 
communication circuitry 32 for communication to a computer (not shown) over 
antenna 22 (FIG. 1). Similarly, data communicated to mouse 10 is received via 
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antenna 22 and RF circuitry 32, and transmitted to controller 24. Controller 24 
communicates with imaging elements 30, RF circuitry 32 and memory 28 over one or 
more buses 34, shown collectively as bold bi-directional arrows. Controller 24 also 
receives electrical signals that correspond to a user*s actuation of a mouse button 12 
(FIG. 1), scroll wheel 14 or other input control. These electrical signals are 
represented collectively in FIG. 2 as "User Input." The various electrical components 
of mouse 10 are powered by a battery 26. 

[28] Although FIGS. 1 and 2 show controller 24, imaging array 18, RF circuitry 32 and 
memory 28 as discrete components, this need not be the case. For example, one or 
more of these components might be contained in a single Integrated Circuit (IC) or 
other component. In at least one embodiment, imaging array 1 8 is contained in an 
integrated circuit containing both light sensitive elements and circuitry for converting 
received light into electrical signals. One such device is described in commonly- 
owned U.S. Patent application Serial Number 10/305,062, titled "Photo-Sensor Array 
for Motion Detection" and filed November 27, 2002. Other image sensor integrated 
circuits are known in the art and are commercially available. As another example, 
controller 24 may include intemal program memory such as ROM. Similarly, the 
herein described functions of these components could be distributed across additional 
components (e.g., multiple controllers or other components). As yet another example, 
LED 20 may be positioned to illuminate a work surface via one or more light guides, 
lenses or other components. 

[29] The required imaging (or "frame") rate for an optical mouse varies based upon the 
velocity with which the mouse moves across a work surface. FIG. 3 shows a portion 
of a work surface 50 over which a mouse moves. Randomly arranged and shaped 
darkened areas represent surface features of work surface 50. Also shown in FIG. 3 
are outlines of two successive images (frame A, frame B) created by the imaging 
elements of a mouse moving across work surface 50. As shown in FIG. 3, there is a 
substantial overlap between frames A and B. FIG. 4 shows enlarged versions of 
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frames A and B. For purposes of explanation, the features of work surface 50 within 
the intersection of frames A and B are shown as darkened shapes in FIG. 4, while the 
other features within frames A and B are shown as outlines. As seen in FIG. 4, the 
direction and amount of surface 50 displacement relative to the mouse imager can be 
determined by comparing frames A and B. If the imager is fixed within the mouse 
housing, this will correspond to mouse movement relative to surface 50. Methods and 
systems for determining displacement based on overlapping images of a work surface 
are known in the art, and thus not further described. Using the time between frames A 
and B and the size of the frame boundary, embodiments of the invention use this 
displacement information to determine the velocity of mouse motion. 

130] FIG. 5 shows what occurs if the frame rate is not sufficiently fast. In the example of 
FIG. 5, there is no overlap between frame A' and frame B'. In other words, the time 
between frames A' and B' was sufficiently long to allow the imaging frame to move to 
a position of no overlap. Because there is no overlap between successive images, 
there are no common features within the images that can be correlated, and the 
displacement of the mouse relative to surface 50 (and thus, mouse velocity) is not 
determinable from frames A* and B*. 

[31] According to at least one embodiment of the invention, controller 24 (FIGS. 1 and 2) 
of mouse 10 varies the activation rate of some or all of imaging elements 30 based on 
the velocity of mouse 10. In the upper portion of FIG. 6, mouse 10 moves over a 
work surface at a velocity v for time t. Although a mouse will typically determine 
displacement along orthogonal axes (e.g., x and y axes), FIG. 6 shows displacement 
(and thus, velocity) in a single arbitrary direction for simplicity. Imaging elements 30 
(FIG. 2) create two overlapping images (frame 0, frame 1) at a rate r = 1/t. In the 
lower portion of FIG. 6, mouse 10 moves over the work surface at a velocity v' (where 
v' > v) for the same amount of time t. During the movement shown in the lower part 
of FIG. 6, imaging elements 30 create N successive images (frames 0 through N) at a 
rate r'. Successive images generated during movement at velocity v' overlap by the 
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same amount as the images created (luring the slower movement at velocity v. So as 
not to obscure the drawing with unnecessary detail, additional overlapping images 
between frame 2 and frame N-1 are represented as an ellipsis. As seen in FIG. 6, rate 
r* = N/t, and r' > r. In other words, during periods of slower movement, imaging 
elements 30 (including LED 20) may be operated at a reduced rate. FIG. 6 is a 
simplified example, and does not include rotation of the imaging frame or curvilinear 
mouse movement. However, most mouse movements can be approximated by a 
series of straight line movements without mouse rotation, and the principle illustrated 
in FIG. 6 also applies in less simplified cases. 

[32] Equation (1) is an example of an equation relating frame rate (F, frames per second) 
to imager velocity (v, inches per second) and the maximum offset between 
overlapping images that can be accurately resolved (Dmax, inches/frame). 

(1) F=v/D^ax 

The quantity Dmax will vary based on the tracking algorithm used (i.e., the algorithm 
used to correlate images and determine relative displacement), but is generally 
determinable for a given tracking algorithm. An example value is 0.0 1 inches per 
frame. In certain embodiments, the velocity (v) used in Equation (1) includes 
components on x and y axes (e.g., the vector sum of x and y axis velocities). In other 
embodiments, only the x or y axis velocity is used. In particular, the velocities on 
both x and y axes are calculated, and the higher velocity used for frame rate 
determination. As the mouse moves at higher velocities, the image rate increases 
proportionally in at least one embodiment, as shown in Table 1 below. 

Table 1 

Mouse Velocity (in./sec.) Image Rate (Hz) 



0.1 



10 
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1.0 



100 



10 



1000 



25 



2,500 



In some embodiments, an additional margin factor is applied in Equation (1) to 
accoimt for uncertainties in the system. For example. Equation (1) is modified to F = 
k:*(v/ Dmax)i where k is a constant greater than 1. In other embodiments, the value of 
k could mcrease as velocity (v) increases. In still other embodiments, the frame rate 
is a function of factors in addition to velocity. For example, and as described below 
in connection with FIG. 9, the imaging rate can also be varied as a function of mouse 
acceleration. 

[33] By adjusting the imaging rate based on velocity, LED 20 is activated less frequently. 
FIGS. 7 and 8 help to show power savings, according to at least one embodiment of 
the invention, which result from varying imaging rate based on mouse velocity. FIG. 
7 shows a velocity profile for a mouse moved reciprocally over a 1 inch section of a 
work surface. The vertical axis is the velocity (in./sec.) of the mouse at a specific 
time shown on the horizontal axis. More specifically, FIG. 7 graphs horizontal (x 
axis) velocity versus time as a user quickly moves a mouse to the right, then to the 
left, then rests, and then repeats the sequence twice more. The movements occur 
within a three second interval, and instantaneous velocity is limited to +/- 25 in./sec. 
The velocity profile of FIG. 7 is an example of the upper limit of mouse velocity for a 
typical user, and illustrates that a mouse is moved at high velocities for a relatively 
small amount of the total time the mouse is being used. 

[34] FIG. 8 shows sampling (or imaging) rate (frames/sec) vs. time for the motion of FIG. 
7. In FIG. 8, the imaging rate is varied based on mouse velocity in a manner similar 
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to that shown in FIG. 6, and with imaging performed at a rate sufficient to assure 
accurate tracking (e.g., to avoid aliasing in the tracking algorithm being used). The 
small offset in FIG. 8 represents a minimum imaging rate performed by the mouse at 
all times (in some embodiments). The lower dashed line represents the average 
imaging rate during the three second interval. The upper dashed line represents the 
maximum imaging rate during that same time period. A tracking algorithm imaging 
at a fixed rate would typically image at the maximum rate. By reducing the average 
imaging rate from the upper ("max") value to a lower ("ave") value, an LED (or other 
illumination source) is activated for less time. 

[35] By reducing the amount of time that LED 20 is activated, battery life is increased. 
Although LED 20 (or other illumination source used) draws a significant amount of 
current, data processing necessary for tracking also contributes to current draw. 
Imaging components are often implemented using CMOS (complementary metal 
oxide semiconductor) technology, and CMOS current draw increases with clock rate. 
Lowering frame rate thus lowers signal processing current draw. Battery life for an 
optically tracking mouse is generally described by Equation (2) 



I_imaging is the current drawn by the imaging elements of the mouse (i.e., the LED 
light source, the imaging array and components performing tracking calculations). 
I_other is the current drawn by the remaining mouse components. Because LED 20 
will draw a large portion of the current drawn by all imaging components, and 
l imaging is greater than l other, the rate at which LED 20 is activated will 
significantly affect battery life. As indicated above, however, other imaging 
components can also draw less current as imaging rate is reduced, i.e., as fewer 
frames are imaged and fewer tracking calculations performed. The increase in battery 



(2) 



Battery Life = 



Battery Capacity (AmpHours) 



I_imaging (amps) + l other (amps) 
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life resulting from imaging at a lower average rate (F^imagCavc) instead of continuing 
to image at a maximum rate (F^imagCmax) is given by Equation (3). 

(3) Incr. Batt. Life = Battery LifeCF image^^^ ) - Battery Life(F_image^^ ) 

If the current drawn by the imaging components at the average and maximum rates is 
respectively I_imageavc and IJmagemaxj and if the current drawn by other mouse 
components at the average and maximimi rates is respectively I_otherave and 
I^otheimax, Equation (3) can then be rewritten as Equation (4). 



(4) Incr.Batt.Life = - (battery Capacity) (Battery Capacity) 



(I_image„. + I_other.„ ) (I.image^ + I_other^ ) 

(Battery Capacity) ( (I_image^^ - IJmage,,, ) + (I_other^ - I_other,,, )) 
(I_image^ + I_other^ ) (I_image.„ + I_other.^ ) 

( (I_image„„ - I_image,„ ) + (I_other^ - I_other„, )) 



= (Battery Life Before Change) ■ 



(I_image3„ + I_other„, ) 



If I_othermax ~ I_otherave, and if I_iraageave » I_otherave> Equation (4) is 
approximated by Equation (5). 



I image 

Incr. Batt. Life = (Battery Life Before Change)((-^ — ^-^) - 1) 
(5) IJmage.,. 



[36] If the current requirement is reduced by one half (I_imageave = I_iniagemax/2), then 
battery life (Battery Life Before Change + Incr. Batt. Life) is doubled. 

[37] FIG. 9 is a flow chart showing an algorithm for mouse 10 that varies imaging rate 
based on mouse velocity and acceleration. After initialization at block 100, controller 
24 calculates the present velocity (v) and acceleration (a) of mouse 10 at block 102. 
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In at least some embodiments, controller 24 calculates velocity and acceleration along 
X and y axes, and adjusts frame rate based on the axis having the highest velocity. In 
other embodiments, frame rate is adjusted based on x and y components of velocity 
and acceleration (e.g., the vector sum of the x and y velocities, the vector sum of the x 
and y accelerations). As described in more detail below, and using the size of the 
imaging frame (a known value) and the time between images (also a known value), 
mouse velocity and acceleration can be computed from three or more successive 
images. Depending on the number of images used for the calculation, additional 
derivatives for mouse motion (e.g., da/dt, or "jerk," and d^a/dt^, or "twitch") are also 
calculated in some embodiments. At block 104, controller 24 adjusts the imaging rate 
Fprediction bascd On the values calculated in block 102. 

[38] In at least one embodiment, controller 24 adjusts the imaging rate Fprediction according 
to Equation (6). 



Fprediction F(Vmargin)5 



where: F( ) is a function mapping to a velocity V the minimum frame 
rate necessary to accurately determine that velocity, 




prediction ' 



if greater than V^j„ , and 



m = a constant (e.g., 0.50), 



Vmin = a minimum frame rate supported by the system. 



So = |Vo|, 



Vo = current velocity (based on current and previous image), 



Ao = (Vo/|Vo|)*(Vo-V.O, 



V.i = previous velocity (based on previous images). 
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V, 



prediction ' 



|So + Ao|, if Aq > 0,and 



So ifAo <0. 



[39] In at least some embodiments, additional power savings are achieved through inertial 
navigation. In particular, the combination of a mouse and a mouse user's hand is 
treated as an inertial mass. Under many usage scenarios, the acceleration of the 
mouse/hand combination tends to be zero (or near-zero) most of the time. If 
acceleration of the mouse/hand combination is near zero, reasonably accurate 
estimations of future mouse displacement can be calculated using previously 
computed values for mouse velocity. As shown in FIG. 10, three successive frames 
(n, n+l and n+2) are taken (at respective times tn, tn+i, tn+2) to determine the horizontal 
(Vx) and vertical (Vy) components of mouse velocity. Based on mouse velocity at 
times tn+i and tn+2, the horizontal (Ax) and vertical (Ay) components of acceleration at 
time tn+2 are also calculated (Ax = (Vx(tn+2) - Vx(tn+i))/(tn+2 - tn+i); Ay = (Vy(tn+2) - 
Vy(tn+i))/(tn+2 - tn+i)). If acceleration is zero, mouse displacement at an arbitrary time t 
can readily be calculated from Vx and Vy. In particular, the x displacement at 
arbitrary time t from the position at tn+2 (frame n+2) is simply the time since tn+2 (i.e., t 
- tn+2) multiplied by Vx. Similarly, the y displacement is the time since tn+2 multipUed 
byVy. 

[40] FIG. 1 1 further illustrates inertial navigation according to at least some embodiments 
of the invention. After determining velocity and acceleration based on frames n, n+1 
and n+2, controller 24 (FIGS. 1 and 2) suspends imaging for a time At, and LED 20 
and other imaging elements 30 are inactive. For times between tn+2 and tn+2 + At, 
controller 24 assumes that Vx and Vy remain unchanged. Using values for Vx and Vy 
calculated during the last set of images n through n+2, controller 24 periodically 
calculates relative displacement along the x and y axes and inserts that information 
into mouse data packets. At times tn+3 (where tn+3 = tn+2 At), tn+4 and tn+5, controller 
24 creates another set of images n+3, n+4 and n+S. Using data from these images, 
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controller 24 updates Vx, Vy, Ax and Ay. Assuming the updated Ax and Ay are 
sufficiently low, controller 24 uses the updated the values of Vx and Vy for the next 
group of relative displacement estimates. Controller 24 also modifies the interval At 
between tn+s and the next set of images (beginning at tn+6, not shown). In at least 
some embodiments, controller 24 increases the interval At if mouse velocity (either 
the highest of Vx and Vy, or a composite such as the vector sum of Vx and Vy) has 
increased. In those embodiments, controller 24 decreases the interval At if mouse 
velocity has decreased. 

[41] If acceleration remains sufficiently small, the error between the estimated and actual 
displacement at time t is also relatively small. In many cases, this error is 
imperceptible to most human users. Even for relatively large values of At, the actual 
time between sets of images is quite short by human perception standards. Most users 
do not change the speed or direction of mouse motion by a large degree during such 
time intervals, and errors between actual and estimated mouse displacement tend to be 
small. On a macro scale, these errors are approximately the same in opposing 
directions (+/- x, +/- y). These errors thus tend to cancel out on a gross level, and a 
cursor controlled by mouse 10 will not wander unpredictably from a screen area in 
which the user may be working. 

[42] In some embodiments, controller 24 ceases inertial navigation upon determining that a 
composite acceleration exceeds a certam threshold level Ath or that a composite 
velocity does not exceed a threshold level Vth- Composite acceleration is a value that 
accounts for both Ax and Ay (e.g., the magnitude of the vector sum of Ax and Ay, 

^A^ + Ay ); composite velocity is a value that accounts for both Vx and Vy (e.g., the 

magnitude of the vector sum of Vx and Vy, + V^ ). In such embodiments, 

controller 24 then returns to imaging at a rate sufficient to create overlapping images. 
Once composite acceleration is below Ath and composite velocity is above Vth, 
controller 24 resumes inertial navigation. 
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[43) FIG. 12 is a flow chart showing inertial navigation by mouse 10 according to at least 
one embodiment of the invention. After initialization at block 200, controller 24 
determines Vx, Vy, Ax and Ay at block 202. Depending on the number of images used 
for the calculation, additional derivatives of mouse motion (e.g., jerk and twitch) are 
also calculated in some embodiments. At block 204, controller 24 determines 
whether the composite velocity V and acceleration A are within bounds of values for 
which inertial navigation is to be used. In particular, controller 24 determines if 
composite velocity is above Vth, the velocity threshold above which inertial 
navigation is to be used. Controller 24 also determines if composite acceleration is 
below Ath, the acceleration threshold below which inertial navigation is to be used. If 
composite velocity and composite acceleration are not within bounds (the "no" branch 
of block 204), controller 24 continues to calculate mouse displacement using 
overlapping images, and returns to block 202. 

[44] If composite velocity and composite acceleration are within bounds (the "yes" branch 
of block 204), controller 24 proceeds to block 206 and enters "image sleep" mode. In 
this mode, controller 24 ceases imaging, thereby turning off LED 20 and other 
imaging elements 30. While in image sleep mode, controller 24 calculates mouse 
displacement based on Vx and Vy. Controller 24 remains in image sleep mode (block 
206) for a time At. In at least some embodiments. At is a function of Vx, Vy, Ax and 
Ay. At the end of At, controller 24 proceeds to block 208 and causes imaging 
circuitry 30 to create enough images to update Vx, Vy, Ax and Ay (as well as to 
calculate any other desired quantities), after which controller 24 returns to block 204. 
If composite velocity is below Vth (based on updated Vx and Vy) or composite 
acceleration is above Ath (based on updated Ax and Ay), controller 24 ceases inertial 
navigation and proceeds to block 202. If composite velocity is above Vth and 
composite acceleration is below Ath, controller 24 proceeds to block 206, where a new 
At is determined and image sleep mode is resumed. 
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[45] In still other embodiments, controller 24 does not resume continuous imaging merely 
because of high acceleration (e.g., when composite acceleration is above Ath). If 
composite acceleration and composite velocity are both relatively high, a user is 
probably engaged in a mouse operation that does .not require high navigation 
accuracy. For example, a user may be rapidly moving a cursor from one major area 
of a display screen to another major area of that screen; in such a case, the user is 
typically not concerned with the precise location of the cursor until it is close to the 
desired destination. Although there may be somewhat larger navigational errors, they 
are unlikely to be noticed. If composite acceleration is high and composite velocity is 
low, the user may be changing direction of mouse motion (e.g., moving the mouse in 
an angular comer movement or in an arc), or may be starting or stopping movement. 
Once again, users will often be less cognizant of navigational errors under such 
circumstances. Moreover, if velocity is low, mouse displacement will also be low, 
thereby minimizing navigational errors. In certain embodiments, controller 24 thus 
ceases estimating mouse displacement for a predetermined time period when 
composite velocity is sufficiently low and composite acceleration is sufficiently high. 
During this time period, controller 24 does not attempt to determine displacement by 
correlating successive overlapping images. This predetermined time, which may be 
stored as a parameter in memory 28 (FIG. 2), can be chosen based on an estimate of 
the amount of time that mouse motion will be minimal during typical changes in 
mouse direction, FIG. 17 is similar to FIG. 12, but includes additional blocks 205 and 
207. From the "no" branch of block 204, controller 24 determines at block 205 
whether composite velocity V is below another threshold value Vth* and whether 
composite acceleration A is above another threshold Ath* (which may in some 
embodiments equal Ath). If not, controller 24 proceeds to block 202 as in FIG. 12. If 
so (the "y^s" branch), controller 24 proceeds to block 207. In block 207, controller 24 
ceases inertial navigation (and in some embodiments, navigation by correlation of 
successive overlapping images) for a time thoid- At the end of thow, controller 24 goes 
to block 208, where Vx, Vy, Ax and Ay are updated. 
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[46J In at least some embodiments, a mouse or other device according to the invention 
further includes proximity detection circuitry to determine whether a user's hand is 
present. When a user's hand is in proximity to the mouse, imaging rate varies based 
on one or more algorithms such as shown in FIG. 9, FIG. 12 or FIG. 17. When a hand 
is not in proximity, the mouse enters a standby mode in which various components of 
the mouse are turned off or are operated at a reduced rate. In some embodiments, 
LED 20 and other imaging elements 30 are periodically activated in standby mode to 
determine if the mouse has moved, but are activated at a rate that is slower than would 
be used to track motion during periods of active use to provide computer input. FIGS. 
13 and 14 are modified versions of FIGS. 1 and 2 showing proximity detection 
components 336' and 336" and detection circuitry 338. In one embodiment, mouse 
310 contains proximity detection component 336', which is a capacitive foil film, as 
described in commonly owned U.S. Patent Application Sen 09/948,099, filed 
September 7, 2001 and published under No. 20020035701 on March 21, 2002. In 
another embodiment, mouse 300 contains proximity detection components 336", 
which include one or more photosensitive elements, as described in commonly owned 
U.S. Patent AppHcation Ser. No. 10/058,384, filed on January 30, 2002, now U.S. 

Patent . Proximity detection could also be incorporated into RF 

circuitry 332, as described in commonly owned U.S. Patent Application Ser. No. 
10/408,125, filed April 8, 2003. Other types of proximity detection could also be 
used. 

147] In still other embodiments, a mouse or other device according to the invention is 
configurable to adjust the algorithm of FIG. 9 and/or the algorithm of FIG. 12 based 
on type of use (or user profile) and an anticipated acceleration for that use type (or 
profile). For example, use intervals with frequent high acceleration and velocity 
components would typify game play, thus necessitating more rapid response to mouse 
movements. A mouse set for a game player would thus suspend inertial navigation or 
reduce the interval At between image sets. Low velocity, long interval transitions 
would be characteristic of graphical users requiring high precision. Low velocity. 
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high accuracy operation is often important in such usage scenarios, and inertial 
navigation could thus be suspended (or At between image sets made very short) for 
low velocity movement. Between these two extremes would be average usage 
profiles typically associated with office applications and web browsing. 

[48] FIG. 15 is a modified version of FIG. 9 showing adjustment of algorithm parameters 
based on a usage profile. Blocks 110, 112 and 114 generally correspond to blocks 
100, 102 and 104 of FIG. 9. At block 111, a usage profile is set. This could occur 
manually, such as by a user setting one or more program parameters on a computer 
with which mouse 10 (or 310) communicates (which parameter(s) would in turn be 
communicated to the mouse and stored in mouse memory), or by manually setting a 
switch or other control on the mouse. Once set, the parameter(s) determine the degree 
by which the imaging rate Fprediction is adjusted for particular values of velocity and 
acceleration (e.g., the value of m could be varied based on the set parameter(s), the 
function F( ) adjusted, etc.) 

[49] FIG. 16 is a modified version of FIG. 12 showing adjustment of algorithm parameters 
based on a usage profile. Blocks 210, 212, 214, 216 and 218 generally correspond to 
blocks 200, 202, 204, 206 and 208 of FIG. 12. At block 211, a usage profile is set 
Once set, the parameter(s) determines the degree by which the image sleep time At is 
adjusted for particular combinations of Vx, Vy, Ax and Ay values; values for Vth and 
Ath are also adjusted based on the usage profile parameters. 

[50] In still other embodiments, a mouse or other device according to the invention is 
configured to receive signals from an extemal source (such as a computer with which 
the mouse is communicating) indicating that imaging rate should be reduced. For 
example, activation of a screen saver program could cause transmission of a signal to 
a mouse indicating that imaging rate should be reduced and/or that inertial navigation 
should be suspended. Such a signal could be received via RF circuitry 32 (FIG. 2) 
and communicated to controller 24. 
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[511 Although specific examples of carrying out the invention have been described, those 
skilled in the art will appreciate that there are numerous variations and permutations 
of the above described systems and techniques that fall within the spirit and scope of 
the invention as set forth in the appended claims. For example, an algorithm similar 
to FIG. 12 could be used for estimating displacement at certain times, and an 
algorithm similar to FIG. 9 used at other times. When varying an imaging rate, the 
rate of activating an illumination source may be varied, the rate of activating other 
imaging elements may be varied, or the rate of activating the illumination source and 
other imaging elements may be varied. Similarly, during periods of displacement 
estimation (or of no displacement determination by any means), activation of the 
illumination source, of other imaging components, or of the illumination source and 
other imaging components may be suspended. The invention could also be used in 
devices other than a mouse. Indeed, the invention can be implemented in connection 
with non-optical sensors (e.g., capacitive sensors, pressure sensors, etc.). The 
algorithms described herein are only examples of possible algorithms by which the 
invention might be implemented; other algorithms could be used. These and other 
modifications are within the scope of the invention as defined by the attached claims. 
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